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RESEARCH  SUMMARIES 


1.  Designing  a  Self-Organizing  Network  that  Calculates  Ti'anslational  Heading 

Navigation  recjuires  heading  ])erce])tion.  For  a  robot  to  maintain  a  constant  heading, 
it  is  insufhcient  to  simply  set  the  wheels  at  a  given  specific  angle  and  assume  the  resulting 
trajectory  is  correct.  .An  autonomous  vehicle  on  a  side-hill,  for  example,  may  have  to  turn 
its  wheels  just  to  maintain  a  constant  heading  due  to  tire  slippage.  Visual  feedback  is  a  more 
reliable  indicator  of  heading.  Algorithms  exist  i,hat  allow  explicit  calculation  of  heading  from 
optic  flow,  but  none  are  self-organizing  and  each  recpiires  having  explicit  knowledge  about 
the  geometry  of  the  sensor,  the  focal  length  of  the  optics,  etc.  Such  parameters  must  be 
recalculated  for  each  variety  of  robot  and  if  they  change  over  time,  the  robot  will  begin  to 
malfunction. 

This  project  investigates  a  .self-organizing  solution  for  determining  heading  from  optic 
flow.  Such  a  solution  is  geneiic.  robust,  and  automatically  adapts  to  a  wide  variety  of 
robotic  systems.  .A  network-like  solution  has  been  developed  based  on  the  stibspace  algorithm 
introduced  by  Heeger  and  .lepson  (1992).  The  subspace  algorithm  calculates  the  translational 
component  of  2D  motion  without  explicit  knowledge  of  depth  or  rotational  velocity.  Its 
stability,  generality,  and  efficiency  place  it  among  the  best  techniciues  available.  Lappe  and 
Rauschecker  (1992)  first  noticed  the  potential  of  expre.ssing  the  algorithm  in  terms  of  a  neural 
model,  but  their  model  is  not  self-organizing. 

Its  weaknesses  are: 

(1)  It  only  handles  forward  translations  in  the  A'-plane: 

(2)  The  weights  need  to  be  calculated  off-line: 

(2)  It  assumes  heading  direction  cells  in  the  heading  map  are  predetermined. 

This  work  has  made  the  following  improvements: 

(1)  The  network  is  self-organizing  for  both  the  heading  field  and  the  weight  field; 

(2)  The  network  determines  heading  for  all  directions  in  the  sphere,  not  just  2-dimensional 
forward  motion. 

.A  schematic  diagram  of  the  heading  network  is  shown  in  Figure  1. 

2.  Building  a  Range  Map  from  Optic  Flow  Information 

.A  second  recpiirement  for  navigation  is  knowledge  of  the  21)  S]ratial  arrangement  of 
objects  in  the  environment.  Information  about  the  depth  of  objects  is  encoded  in  optic  flow 
but  somewhat  difficult  to  extract  when  arbitrary  motions  of  the  observer  are  allowed.  This 
project  investigA,Les  how  to  use  information  from  the  heading  network  to  build  a  range  map 
of  the  visual  scene. 

Since  two  unknowns,  translational  velocity  and  inverse  dejrth,  are  multiplied  by  each 
other  in  the  optic  flow  ecjuation,  optic  flow  cannot  give  information  about  absolute  speed 
of  the  navigator  or  absolute  depth  of  ol)jects.  However,  a  self-organizing  network  has  been 
developed  that  yields  relative  inverse  dejith  information.  When  travelling  parallel  the  optic 
axis,  the  relative  depth  information  becomes  ecpiivalent  to  a  tirne-to-collision  measurement. 

The  network,  shown  in  Figure  2,  uses  extraretinal  information  regarding  eye  rotational 
velocities  and  heading  direction  from  the  previously  describe  network  to  self-organize  into 
a  range  map.  Future  work  will  involve  placing  the  eye-centered  range  information  into  a 
body-centered  re]nesentation  for  navigation. 

3.  Neural  Controller  for  a  Mobile  Robot 

Since  the  earliest  stages  of  this  ])r()ject,  Profe.ssor  (landiano  has  been  involved  with  the 
develo])ment  of  a  neural  network  for  the  low-level  control  of  a  niolfile  robot.  This  line  of  work 
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Figure  1.  Self  organizing  network  for  extracting  eye-centered  ego-motion. 


Figure  2.  Self-organizing  range  network. 
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has  been  extended  during  the  cotirse  of  the  irroject  year,  and  is  the  sub  ject  ol  further  reseaiadi. 
A  first  manuscript  describing  the  neural  controller  will  appear  shortly  in  the  international 
journal  Neunil  Setwovks.  A' second  article  has  been  acce]->ted  (])ending  some  revisions)  for 
publication  in  a  si)ecial  issue  of  the  IEEE  Transnctiont^  on  Systeins.  Man.  and  Cybernetics. 
The  latter  article  provides  more  rigorous  tests  and  analyses  of  noise  re.sistimce  in  the  neural 
controller:  it  ])rove^  asymiA.otic  stalnlity  of  t  he  neural  control  scheme;  and  it  illustrates  some 
initial  attempts  to  implement  the  neural  controller  using  the  commercially  available  robot 
ROBVTER.  The  results  olAained  to  date  demonstrate  that  the  proposed  neural  controller 
offers  a  viable  alternative  to  more  traditional  controllers,  especially  when  the  robot  must 
operate  in  an  unknown  or  nonstationary  enviidnment. 

We  have  also  begun  formal  development  of  a  neural  architecture  for  navigation  and  ob¬ 
stacle  avoidance,  to  be  used  in  conjunction  with  the  low-level  controller.  The  architectuie. 
which  had  been  sketched  in  an  earlier  progress  report,  combines  information  about  target 
and  obstacles  into  a  spatial  map.  The  target  is  represented  as  a  positive  Ciaussian  distiibu- 
tion  of  activity,  while  each  obstacle  is  represented  as  a  negative  Ciaussian.  (combination  of 
all  (laussians  into  a  spatial  map  generates  an  activity  surface  similar  to  the  functions  used  in 
so-called  "potential  field'’  approaches  to  navigation,  which  typically  utilize  gradient  descent 
procedures  to  locate  the  maximum  of  the  potential  field  corresponding  to  the  given  configu¬ 
ration  of  target  and  obstacles.  Unlike  potential  field  approaches,  the  approach  proposed  here 
does  not  make  use  of  gradient  descent:  instead,  the  competition  in  the  spatial  map  makes 
it  possible  to  extract  a  time- varying  peak  whose  position  reflects  the  moment-by-moment 
direction  that  the  robot  must  follow  in  order  to  reach  the  target  while  navigating  around 
obstacles. 


In  the  most  recent  itrogress  report,  a  diagram  had  been  included  to  illustrate  how  such  a 
scheme  might  be  irnjdemented  within  the  context  of  a  conditionln^o,  circuit,  a  neuial  netwoik 
model  proposed  by  (Irossberg  to  explain  how  humans  and  animals  can  learn  to  exhibit  ap¬ 
propriate  avoidance  or  approach  behavior  in  response  to  a  given  set  of  external  sensory  cue.s. 
while  also  taking  into  account  the  human’s  (or  animal's)  internal  needs.  In  that  proposal, 
it  was  suggested  that  each  item  in  the  environment  that  icpresents  an  obstacle  or  target, 
is  stored  m  memory  along  with  its  position  in  space.  However,  it  was  suggested  that^each 
object’s  jtosition  would  be  stored  in  allocentric  (i.e.,  relative  to  a  fixed  external  frame)  C.aite- 
sian  coordinates.  We  have  found  that  a  better  performance  is  obtained  by  utilizing  instead 
an  egocentric  polar  map,  in  which  the  position  of  the  target  and  obstacles  are  continuously 
updated  as  the  robot  moves  in  space.  With  this  scheme  we  have  been  able  to  demonstrate 
robust  obstacle  avoidance  in  the  presence  of  moving  or  stationary  target  and  obstacles,  for 
a  variety  of  configurations  of  obstacles.  We  are  currently  extending  this  work  to  include 
modulation  of  the  (laussians  as  a  function  of  internal  needs,  for  example,  as  a  function  of 
the  robot’s  need  to  recharge  its  Iratteries.  W’e  are  developing  schemes  to  avoid  getting  caught 
in  “local  minin'a”,  for  instance  when  the  robot  is  surrounded  by  obstacles,  while  the  only 
possible  path  out  of  the  obstacle  area  is  in  a  direction  opposite  that  of  the  target.  We  expect 
to  ])resent  our  ])reliniinary  results  on  this  work  at  a  relevant  conference,  and  to  complete  a 
full-length  pulrlication  describing  this  w'ork  sometime  in  1995. 


4.  Neural  Networks  for  Learning  a  Body-Centered  Representation  of  3-D  Target 
Position 

This  w'ork,  to  ajprear  in  the  .Journal  of  Cognitive  Neuroscience,  rei^resents  the  third  article 
in  a  series  aimed  at  modeling  how  the  luxiin  autonomously  learns  sjratial  representations 
ca])able  of  controlling  flexible  goal-oriented  movements.  In  it,  (Irossberg  and  Cuenther, 
working  wnth  Dan  Bvdlcjck  and  Doug  Clreve,  designed  a  nc:;ui'al  netwoik  to  model  how  the 
brain  may  autonomously  learn  a  body-centered  representation  of  3-D  target  position  by 
combining  information  about  retinal  target  jjosition,  C::y(:‘  ])osition,  and  head  ]rosition  in  leal 
time.  Such  a  body-centered  s]iatial  re]u-c-:sentation  enables  accurate  movement  commands  to 
the  limbs  to  lie  generated  desjiitc-’  changes  in  the  s]iatial  relationshi]is  between  the  eyes,  head, 


body,  and  limbs  through  time.  The  rP])resc'nta.tion  is  a  vector  rP])resentation — otherwise 
known  as  a  j^arcella.ted  distrilnited  representation — of  target  vergence  with  respect  to  the 
two  eyes,  and  of  the  horizontal  and  vertical  spherical  angles  of  the  target  with  respect  to 
a  cyciopean  egocenter.  A  similar  representation  has  been  reported  in  the  caudal  niidbrain 
and  medulla  of  the  frog,  as  well  as  in  psychophysical  movement  studies  in  humans.  A  head- 
centered  vector  representation  of  this  type  is  generated  by  two  stages  of  o])ponent  processing 
that  combine  corollary  discharges  of  outflow  movement  signals  to  the  two  eyes.  This  head- 
centered  vector  representation  interacts  with  representations  of  neck  movement  commands 
to  generate  a  body-centered  estimate  of  target  position.  The  contributions  of  the  neck 
command  signals  to  this  vector  representation  are  learned  during  head  movements  made 
while  the  gaze  remains  fixed  on  a  foveated  target.  .4n  initial  estimate  is  stored  and  offset 
of  a  gating  signal  prevents  the  stored  estimate  from  being  reset  during  a  gaze-maintaining 
head  movement.  As  the  head  moves,  new  estimates  are  generated  and  compared  with  the 
stored  estimate.  If  the  estimates  are  uneciual,  the  comparison  generates  non-zero  difference 
vectors,  which  act  as  error  signals  to  drive  the  learning  process. 

5.  3-D  Vision  and  Figure-Ground  Separation  by  Visual  Cortex 

In  this  work,  which  appeared  this  year  in  Perception  &nd  Psychophysics,  Crossberg  fur¬ 
ther  developed  a  neural  network  theory  of  3-D  vision,  called  FACADE  Theory.  The  theory 
proposes  a  solution  of  the  classical  figure-ground  problem  for  biological  vision.  It  does  so  by 
suggesting  how  boundary  representations  and  surface  representations  are  formed  within  a 
Boundary  Contour  System  (BCS)  and  a  Feature  (bntour  System  (FCS).  The  BCS  and  FCS 
interact  reciprocally  to  form  3-D  boundary  and  surface  representations  that  are  mutually 
consistent.  Their  interactions  generate  3-D  percepts  wherein  occluding  and  occluded  object 
parts  are  separated,  completed,  and  grouped.  The  theory  clarifies  how  preattentjve  processes 
of  3-D  perception  and  figure-ground  separation  interact  reciprocally  with  attentive  processes 
of  spatial  localization,  object  recognition,  and  visual  search.  A  new  theory  of  stereopsis  is 
proposed  that  predicts  how  cells  .sensitive  to  multiple  spatial  frequencies,  disparities,  and  ori¬ 
entations  are  combined  by  context-sensitive  filtering,  competition,  and  cooperation  to  form 
coherent  BCAS  boundary  segmentations.  Several  factors  contribute  to  figure-ground  pop- 
out,  including:  boundary  contrast  between  .spatially  contigupus  boundaries,  whether  due  to 
scenic  differences  in  luminance,  color,  .spatial  frequency,  or  disparity;  partially  ordered  inter¬ 
actions  from  larger  spatial  scales  and  disjjarities  to  smaller  scales  and  disparities;  and  surface 
filling-in  restricted  to  regions  surrounded  by  a  connected  boundary.  Phenomena  such  as  3-D 
pop-out  from  a  2-D  picture,  DaVinci  stereopsis,  3-D  neon  color  spreading,  completion  of 
partially  occluded  objects,  and  figure-ground  reversals  are  analysed.  The  BC.S  and  FC.S  sub¬ 
systems  model  aspects  of  Ifow  the  two  parvocellular  cortical  processing  streams  that  join  the 
Lateral  (leniculate  Nucleus  to  prestriate  cortical  area  V4  interact  to  generate  a  multiplexed 
representation  of  Form-And-Color-And-DEpth,  or  FACADE,  within  area  V4.  Area  V4  is 
suggested  to  support  figure-ground  separation  and  to  interact  with  cortical  mechanisms  of 
spatial  attention,  attentive  object  learning,  and  visual  search.  Adaptive  Resonance  Theory 
(ART)  mechanisms  model  aspects  of  how  prestriate  visual  cortex  interacts  reciprocally  with 
a  visual  object  recognition  system  in  inferoternporal  cortex  (IT)  for  purposes  of  attentive 
object  learning  and  categorization.  Object  attention  mechanisms  of  the  What  cortical  pro¬ 
cessing  stream  through  IT  cortex  are  distinguished  from  spatial  attention  mechanisms  of 
the  Where  cortical  processing  stream  through  ])arietal  cortex.  F’arvocellular  BCS  and  FCS 
signals  interact  with  the  model  What  steam.  F’arvocellular  FC.S  and  magnocellular  Motion 
BCS  signals  interact  with  the  model  Where  stream.  Reci])iocal  interactions  between  these 
visual.  What,  and  Where  mechanisms  are  used  to  discuss  data  aljout  visual  search  and  sac¬ 
cadic  eye  movements,  including  fast  search  of  conjunctive  targets,  search  of  3-D  surfaces, 
selective  search  of  like-colored  targets,  attentive  tracking  of  multi-element  groupings,  and 
recursive  search  of  simultaneously  presented  targets.  These  interactions  shed  new  light  on 
how  spatial  and  recognition  mechanisms  interact  to  identify  targets  moving  in  S])ace. 
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6.  A  Neural  Theory  of  Attentive  Visual  Search:  Interactions  of  Visual,  Spatial, 
and  Object  Representations 

Visual  search  by  Imiiiaiis  for  targets  distrihuted  in  space  aniong  distractors  is  reniarkahly 
efficient.  In  this  work,  which  ajrjreared  this  year  in  Psychological  Review.  Clrossberg,  Min- 
golla,  and  Ross  show  how  visual  search  data  can  be  given  a  unified  (piantitative  explanation 
by  a  model  of  how  sjaUial  majrs  in  the  parietal  cortex  and  object  recognition  categories  in  the 
infe.rotemporal  cortex  dejdoy  attentional  resources  as  they  reciprocally  interact  with  visual 
representations  in  the  prestriate  cortex.  The  model  visual  representations  are  organized  into 
multiple  boundary  and  surface  representations.  Visual  search  in  the  model  is  initiated  by 
organizing  multiple  items  that  lie  within  a  given  boundary  or  surface  representation  into 
a  candidate  search  grouping.  These  items  are  matched  with  object  recognition  categories 
to  test  for  matches  or  mismatches.  Mismatches  can  trigger  deeper  searches  and  recursive 
selection  of  new  groupings  until  a  target  object  is  identified.  This  search  model  is  algo¬ 
rithmically  specified  to  ([uantitatively  simulate  search  data  using  a  single  set  of  parameters, 
as  well  as  to  ciualitatively  ex])lain  a  still  larger  data  base,  including  data  of  Aks  and  Enns 
(1992),  Bravo  and  Blake  (1990),  Egeth,  Virzi.  and  (larbart  (1984),  dohen  and  Ivry  (1991), 
Enns  and  Rensink  (1990).  He  and  Nakayama  (1992),  Humphreys,  Quinlan,  and  Riddoch 
(1989).  .Mordkotf,  Yantis.  and  Egeth  (1990),  Nakayama  and  Silverman  (1986),  Treisman  and 
Celade  (1980),  Treisman  and  Sato  (1990),  Wolfe,  dave,  and  Franzel  (1989),  and  Wolfe  and 
Friedman-Hill  (1992).  The  model  hereby  provides  an  alternative  to  recent  variations  on  the 
Feature  Integration  and  duided  Search  models,  and  grounds  the  analysis  of  visual  search 
in  neural  models  of  preattentive  vision,  attentive  object  learning  and  categorization,  and 
attentive  spatial  localization  and  orientation. 

7.  The  What-and-Where  Filter:  A  Spatial  Mapping  Neural  Network  for  Object 
Recognition  and  Image  Understanding 

In  this  work.  Carpenter,  drossberg,  and  dreg  Lesher  have  modeled  a  What-and-Where 
filter  that  forms  part  of  a  neural  network  architecture  for  spatial  mapping,  object  recognition, 
and  image  understanding.  The  Where  filter  responds  to  an  image  figure  that  has  been  sepa¬ 
rated  from  its  Ijackground.  It  generates  a  spatial  map  whose  cell  activations  simultaneously 
represent  the  position,  orientation,  and  size  of  the  figure  (where  it  is).  This  spatial  map  may 
be  used  to  direct  spatially  localized  attention  to  these  image  features.  A  rnultiscale  array  of 
oriented  detectors,  followed  by  competitive  interactions  between  position,  orientation,  and 
size  scales,  is  used  to  define  the  Where  filter.  The  Where  filter  may  be  used  to  transform 
the  image  figure  into  an  invariant  representation  that  is  insensitive  to  the  figure’s  original 
position,  orientation,  and  size.  This  invariant  figural  representation  forms  part  of  a  system 
devoted  to  attentive  object  learning  and  recognition  (what  it  is).  The  Where  spatial  map 
of  all  the  figure»,jn  an  image,  taken  together  with  the  invariant  recognition  categories  that 
identify  these  figures,  can  be  used  to  learn  multidimensional  representations  of  objects  and 
their  spatial  relationships  for  jnirposes  of  image  understanding.  The  What-and-Where  filter 
is  inspired  by  neurobiological  data  showing  that  a  Where  processing  stream  in  the  cerebral 
cortex  is  used  for  attentive  spatial  localization  and  orientation,  whereas  a  What  processing 
stream  is  used  for  attentive  object  learning  and  recognition. 

8.  A  Collection  of  ART-Family  Graphical  Simulators 

The  Adaptive  Resonance  Theory  (ART)  architecture,  first  proposed  by  Grossberg,  is 
a  self-organizing  neural  network  for  stable  jrattern  categorization  in  resironse  to  arbitrary 
input  sequences.  Since  its  original  formulation,  several  versions  of  ART  have  been  proposed, 
each  designed  to  handle  a  ])articular  task  or  iiqrut  format.  Recent  ART  architectures  have 
been  devekqred  by  (kiipenter  and  Grossberg  working  with  GNS  graduate  students.  Some  of 
these  models  have  been  designed  to  work  in  a  supervised  fashion,  offering  a  viable  alternative 
to  supervised  neural  networks  such  as  ba.ckpro])aga.tion.  Perha])S  the  best-known  variant  of 
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ART  is  ART  2,  an  unsupei  vised  neural  network  that  handles  analog  inputs.  In  collaboration 
with  a  graduate  student,  F’rofessor  (Jaudiano  has  developed  a  series  of  simulators  for  some 
of  the  ART-family  neural  architectures,  namely,  ART  2,  ART2-A.  Fuzzy  ART,  and  Fuzzy 
ARTMAP.  These  simulators,  which  will  soon  become  available  on  the  public  domain,  are 
written  in  ('+-f  and  utilize  the  Tcl/Tk  language  for  the  graphical  user  interface.  The  software 
was  implemented  on  UNIX  and  NeXT  workstations,  and  should  be  easily  ported  to  other 
platforms.  It  is  expected  that  this  software  package  will  be  utilized  extensively  both  as  a 
pedagogical  tool  and  as  a  tool  for  research  around  the  world. 
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CEREBELLAR  LEARNING  IN  AN  OPPONENT 
MOTOR  CONTROLLER  FOR  ADAPTIVE  LOAD 
COMPENSATION  AND  SYNERGY  FORMATION 

Daniel  Bullockf,  Jose  L.  (butreras-VidaU,  and  Stephen  Crossberg§ 

Technical  Report  (:AS/CNS-TR-93-009 
Boston,  MA:  Boston  University 

In  Proceedings  of  the  World  Congress  on  Neural  Networks 
Hillsdale,  NJ:  Erlbaum  Associates,  1993,  IV,  481-4S6 


Abstract 

This  paper  shows  how  a  minimal  neural  network  model  of  the  cerebellum  may  be  em¬ 
bedded  within  a  sensory-neuro-muscular  control  system  that  mimics  known  anatomy  and 
physiology.  With  this  embedding,  cerebellar  learning  promotes  load  compensation  while 
also  allowing  both  coactivation  and  reciprocal  inhibition  of  sets  of  antagonist  muscles.  In 
particular,  we  show  how  synaptic,  long  term  depression  guided  by  feedback  from  muscle 
stretch  receptors  can  lead  to  trans-cerebellar  gain  changes  that  are  load-compensating.  It  is 
argued  that  the  same  processes  help  to  adaptively  discover  multi-joint  synergies.  Simulations 
of  rapid  single  joint  rotations  under  load  illustrates  design  feasibility  and  stability. 


t  Supported  in  part  by  the  National  Science  Foundation  (NSF  IRI  90-24877  and  NSF  IRI 
87-16960)  and  the  Office  of  Naval  Research  (ONR  N00014-92-J-1309). 

t  On  leave  from  Monterey  Institute  of  Technology,  Mexico.  Supported  in  part  by  CONA- 
CYT  #63462. 

§  Supported  in  jnirt  by  the  Air  Force  Office  of  Scientific  Research  (AFOSR  F49620-92- 
.1-0499),  ARPA  (AFOSR  90-0083  and  ONR  N00014-92-.J-4015),  and  the  Office  of  Naval 
Research  (ONR  N00014-92-.J-1309). 
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A  SELF-ORGANIZING  NEURAL  NETWORK 
FOR  LEARNING  A  BODY-CENTERED  INVARIANT 
REPRESENTATION  OF  3-D  TARGET  POSITION 


Daniel  Bullock,  Douglas  Creve,  Stephen  Crossberg,  and  Frank  H.  (hienther 

Technical  Report  {'AS/('NS-TR-9:T010 
Boston,  MA:  Boston  University 

In  Proceedings  of  the  World  Congress  on  Neural  Networks 
Hillsdale,  NJ:  Erlbaurn  Asspciates,  1993,  I,  405-408 


Abstract 

This  paper  describes  a  self-organizing  neural  network  that  rapidly  learns  a  body-centered 
representation  of  3-D  target  positions.  This  representation  remains  invariant  under  head 
and  eye  movements,  and  is  a  key  component  of  sensory-motor  systems  for  producing  motor 
equivalent  reaches  to  targets  (Bullock,  Crossberg,  and  Cuenther,  1993). 


This  work  was  suirported  in  irart  by  grants  NSF  IRI  87-16960,  NSF  IRl  90-24877,  and 
AFOSR  F49620-92-.J-0499. 
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A  SELF-ORGANIZING  NEURAL  MODEL  OF 
MOTOR  EQUIVALENT  REACHING  AND  TOOL  USE 
BY  A  MULTIJOINT  ARM 

[)aniel  Bullockt,  Stejihen  (Jrossliergt.  and  Frank  H.  (luentherj 
.lourna}  of  ('ognitive  Neuroscience,  1993,  5,  408-435 


Abstract 

This  paper  describes  a  self-organizing  neural  model  for  eye-hand  coordination.  Called  the 
DIRECT  model,  it  embodies  a  solution  of  the  classical  motor  eciuivalence  problem.  Motor 
ecpiivalence  computations  allow  humans  and  other  animals  to  flexibly  employ  an  arm  with 
more  degrees  of  freedom  than  the  space  in  which  it  moves  to  carry  out  spatially  defined  tasks 
under  conditions  that  may  recpure  novel  joint  configurations.  During  a  motor  babbling  phase, 
the  model  endogenously  generates  movement  commands  that  activate  the  correlated  visual, 
spatial,  and  motor  information  that  are  used  to  learn  its  internal  coordinate  transformations. 
After  learning  occurs,  the  model  is  capable  of  controlling  reaching  movements  of  the  arm 
to  prescribed  spatial  targets  using  many  dilferent  combinations  of  joints.  When  allowed 
visual  feedback,  the  model  can  automatically  perform,  without  additional  learning,  reaches 
with  tools  of  variable  lengths,  with  clamped  joints,  with  distortions  of  visual  input  by  a 
prism,  and  with  unexpected  perturbations.  The.se  compensatory  computations  occur  within 
a  single  accurate  reaching  movement.  No  corrective  movements  are  needed.  Blind  reaches 
using  internal  feedback  have  also  been  simulated.  The  model  achieves  its_  competence  by 
transforming  visual  information  about  target  ])Osition  and  end  eifector  position  in  3-D  space 
into  a  body-centered  spatial  reju'esentation  of  the  direction  in  3-D  S])ace  that  the  end  effector 
must  move  to  contact  the  target.  The  spatial  direction  vector  is  adaj^tively  transformed  into 
a  motor  direction  vector,  which  rejuesents  the  joint  rotations  that  move  the  end  effectoi  in 
the  desired  spatial  direction  from  the  present  arm  configuration.  P’roperties  of  the  model 
are  compared  with  jxsychophysical  data  on  human  reaching  movements,  neurophysiological 
data  on  the  tuning  curves  of  neurons  in  the  monkey  motor  cortex,  and  alternative  models  of 
movement  control. 


■%- 


t  Supported  in  part  by  the  National  Science  Foundation  (NSF  IRl  90-24877),  and  the 
Office  of  Naval  Research'(ONR  N00014-92-.T1309) 

+  Su])])orted  in  jrart  by  the  Air  Force  Ofice  of  Scientific  Research  (AFOSR  F49620-92-.J- 
0499)  and  the  National  Science  Foundation  (NSF  IRl  90-24877) 
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A  NEURAL  NETWORK  MODEL  FOR 
CURSIVE  SCRIPT  PRODUCTION 

Daniel  Bullockt,  Stephen  Crossl)ergL  and  Christian  Mannes§ 

Technical  Report  CAS/CNS  TK-92-029 
[doston.  MA:  Boston  University 
Biological  Cybernetics,  1993,  70,  15-28 


Abstract 

This  article  describes  a  neural  network  model,  called  the  VITEWRITE  model,  for  gen¬ 
erating  handwriting  movements.  The  model  consists  of  a  secpiential  controller,  or  motor 
program,  that  interacts  with  a  trajectory  generator  to  move  a  hand  with  redundant  degrees 
of  freedom.  The  neural  trajectory  generator  is  the  Vector  Integration  to  Endpoint  (VITE) 
model  for  synchronous  var'i aide- speed  control  of  multijoint  movements.  VITE  properties 
enable  a  simple  control  strategy  to  generate  com]dex  handwritten  script  if  the  hand  mpdel 
contains  redundant  degrees  of  freedom.  The  proposed  controller  launches  transient  direc¬ 
tional  commands  to  independent  hand  synergies  at  times  when  the  hand  begins  to  move, 
or  when  a  velocity  peak  in  a  given  synergy  is  achieved.  The  VITE  model  translates  these 
temporally  disjoint  synergy  commands  into  smooth  curvilinear  trajectories  among  tempo¬ 
rally  overlapping  synergetic  movements.  The  separate  “score’'  of  onset  times  used  in  most 
prior  models  is  hereby  replaced  by  a  self-scaling  activity-released  “motor  program”  that  uses 
few  memory  resources,  enables  each  synergy  to  exhibit  a  unimodal  velocity  profile  during 
any  stroke,  generates  letters  that  are  invariant  under  speed  and  size  re, scaling,  and  enables 
effortless  connection  of  letter  shapes  into  words.  .Speed  and  size  rescaling  are  achieved  by 
scalar  CO  and  CRO  signals  that  express  computationally  simple  volitional  pmmands.  Psy¬ 
chophysical  data  concerning  hand  movements,  such  as  the  isochrony  principle,  asymmetnc 
velocity  profiles,  and  the  two-thirds  power  law  relating  movement  curvature  and  velocity 
arise  as  emergent  ju'oirerties  of  model  interactions. 


t  Supported  in  ])art  by  the  National  Science  Foundation  {NSF  IRI  90-24877  and  NSF  IRI 
87-16960)  and  the  Office  of  Naval  Re.search  (ONR.  N00014-92-.J-1309). 

t  Sup])orted  in  ]iart  by  Air  Force  Office  of  Scientific  Research  (AFOSR  F49620-92- .1-0499), 
[)ARF‘A  (AFOSR  90-0083),  the  National  Science  Foundation  (NSF  IRl  90-24877  and  NSF 
IRI  87-16960),  and  the  Office  of  Naval  Re.search  (ONR  N00014-92- .1-1309). 
fj  Sup])orted  in  jrart  by  the  National  Science  Foundation  (NSF  IRl  90-24877). 


MOTIVATION 

Clark  Dormant  and  F’aolo  CaudianoJ 

Technical  Report  (’A.S/CN.S-TR-94-020 
Boston,  MA:  Boston  Universityy 
To  appear  in  M.  Arbib  (Ed.) 

Handbook  of  Brain  Theory  and  Neural  Networks 
Cambridge,  MA:  MIT  Press,  in  press,  1994 


Abstract 

The  ability  of  humans  and  animals  to  survive  in  a  constantly  changing  environment  is 
a  testament  to  the  power  of  biological  processes.  At  any  moment  in  oui  lives,  we  are  faced 
with  many  sensory  stimuli,  and  we  can  typically  generate  a  large  number  of  behaviors’.  How 
do  we  learn  to  ignore  irrelevant  information  and  suppress  inappropriate  behavior  so  that  we 
may  function  in  a  complex  environment? 

In  this  chapter  we  discuss  iiiotiv&tioii,  the  internal  force  that  produces  actions  on  the 
basis  of  the  momentary  balance  between  our  needs  and  the  demands  of  our  environment. 
We  first  give  a  description  of  motivation  and  how  it  is  studied,  focusing  on  behavioral  and 
phj'siological  studies.  We  then  discuss  the  role  of  motivation  in  behavioral  theories  and 
neural  network  modeling. 


t  .Supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  (AFOSR  F49620-92-.]- 
0334). 

t  Supported  in  part  by  the  Air  Force  Office  of  Scientific.  Research  (AFOSR  F49620-92-.]- 
0499)  and  the  Sloan  Foundation  (BR-3r22). 
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AN  UNSUPERVISED  ERROR-BASED  NEURAL  NETWORK 
MODEL  FOR  THE  GENERATION  AND  CONTROL 
OF  MOVEMENT  TRAJECTORIES 

r’a.olo  (^aiulianot 

In  Proceedings  of  the  AAAS  Science  Innovation  Conference 
August  6-10,  1093,  Boston.  Massachusetts,  93-21S.  108-109 


Abstract 

How  can  humans  and  animals  be  able  to  carry  out  novel  motor  tasks  that  they  have 
never  learned  before?  How  is  perc.e])tual  information  about  their  environment  transformed 
into  spatial  representations  that  can  be  used  to  generate  accurate  motor  commands.'*  In 
this  talk  I  will  present  the  Vector  Associative  Map  _(VAM),  a  self-organizing,  unsupervised 
neural  network  model  that  has  been  applied  to  a  variety  of  problems  in  the  adaptive  control 
of  movemente  trajectories.  The  VAM  was  derived  from  the  Vector  Integration  To  Endpoint 
(VITE)  model  (Bullock  c<c  Crossberg,  1988,  Psych.  Rev..  95,  49)  for  the  generation  and 
control  of  movement  trajectories.  The  VAM  model  has  been  applied  to  a  variety  of  learning 
tasks,  including  intramodal  calibration  of  arm  control  parameters,  intermodal  learning  of 
spatial-to-motor  maps  (Gaudiano  h  Crossberg,  1991,  Neural  Networks.  4,  147),  andjearning 
an  invariant  representation  of  3-f)  target  positions  in  head-centered  coordinates  (Guenther, 
Bullock,  Greve,  Crossberg,  ■].  Cog.  Neurosci..  in  press).  The  V.\.M  model  advances  our 
understanding  of  brain  function  in’  the  realm  of  adaptive  motor  control,  and  it  holds  great 
]X)tential  for  practical  apidications  in  robotics  and  control. 


t  Supported  in  i)art  by  the  Air  Force  Office  of  Scientific  Research  (AFOSR  F496‘20-9‘2-.J- 
0499)  and  the  Sloan  Foundation  (BR-3r22). 
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A  NONLINEAR  A^ODEL  OF  SPATIOTEMPORAL 
RETINAL  PROCESSING:  SIMULATIONS  OF 
X  AND  Y  RETINAL  GANGLION  CELL  BEHAVIOR 


F’aolo  Caiulianof 

Technical  Report  (!AS/('NS-TR-93-04S 
Boston,  MA:  Boston  University 
Vision  Reseiirch,  1994,  34,  1767-1784 


Abstract 

This  article  introduces  a  nonlinear  model  of  neural  processing  in  the  vertebrate  retina, 
comprising  model  photoreceptors,  model  push-pull  bipolar  cells,  and  model  ganglion  cells. 
Analyses  and  simulations  show  that  the  model  can  account  for  several  aspects  of  both  X  and 
Y  cat  retinal  ganglion  cell  behavior.  In  particular,  with  a  choice  of  parameters  that  mimics 
beta,  cells,  the  inodel  exhibits  X-like  linear  spatial  summation  (null  response  to  contrast- 
reversed  gratings)  in  spite  of  photoreceptor  nonlinearities;  on  the  other  hand,  a  choice  of 
parameters  that  mimics  alpha  cells  leads  to  Y-like  frequency  doubling.  These  and  other 
results  suggest  that  X  and  Y  cells  can  be  seen  as  variants  of  a  single  neural  circuit.  The 
model  also  suggests  that  both  depolarizing  and  hyperpolarizing  bipolar  cells  converge  onto 
both  ON  and  OFF  ganglion  cell  types,  although  tile  effects  of  this  push-pull  convergence  can 
be  elusive  when  recording  from  individual  ganglion  cells.  These  hypotheses  are  supported  in 
the  article  by  a  number  of  com])uter  simulation  results. 


t  Su])])orted  in  ])art  by  the  Air  Force  Office  of  Scientific  Research  (AFOSR  F4 9620-92-.]- 
0499)  and  the  Sloan  Foundation  (BR-3122). 
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THE  NEURAL  DYNAMICS  APPROACH  TO  SENSORY-MOTOR  CONTROL: 
OVERVIEW  AND  RECENT  APPLICATIONS  IN  MOBILE  ROBOT 
CONTROL  AND  SPEECH  PRODUCTION 


F’aolo  (wviuiianot,  Frank  H.  Cuentherl.  and  Eduardo  Zalaina 
Invited  article  to  a]rpear  in  Progress  in  Neural  Networks 


Abstract 

This  chapter  discusses  a  collection  of  niodtds  that  utilize  adaptive  and  dynamical  prop¬ 
erties  of  neural  networks  to  solve  problems  of  sensory-motor  control  for  biological  organisms 
and  robots.  The  chapter  begins  with  an  overview  of  several  unsupervised  nemral  network 
models  developed  at  the  Center  for  Adaptive  Systems  during  the  past  decade.  Thes^e  rnodels 
have  been  used  to  explain  a  variety  of  data  in  research  areas  ranging  from  the  cortical  cxin- 
trol  of  eve  and  arm  movements  to  spinal  regulation  of  muscle  length  and  tension.  Aext,  two 
recent  models  that  build  on  important  concepts  from  this  earlier  work  are  presented,  i  le 
first  of  these  models  is  an  adaptive  neural  network  controller  for  a  visually-guided  niobile 
robot.  The  neural  network  controller  enables  the  robot  to  move  to  arbitrary  targets  without 
anv  knowledge  of  the  robot’s  kinematics,  immediately  and  automatically  compensating  tor 
perturbations  such  as  target  movements,  wheel  slippage,  or  changes  in  the  robot  s  plants 
The  controller  also  adapts  to  long-term  perturbations,  enabling  the  robot  to  compensate  tor 
statisticallv  significant  changes  in  its  plant.  The  second  model  is 

work  addressing  speech  motor  skill  accpiisition  and  speech  production.  This  model  explains  a 
wide  range  of  data  on  contextual  variability,  motor  equivalence,  coarticulation,  and  speaking 
rate  etfeUs.  Model  ]iarameters  are  learned  during  a  babbling  phase,  using  only  information 
available  to  a  lialililing  infant.  After  learning,  the  model  can  produce  arbitrary  phoneme 
strino-s  again  exhilnting  automatic  compensation  for  perturbations  or  constraints  on  the 
articulators.  Finally,  other  recent  models  using  a  neural  dynamics  approach  are  summaiized 
and  future  research  avenues  are  outlined. 


t  Supported  in  ]iart  liy  the  Air  Force  Office  of  Scientific  Research 
0499)  and  the  Sloan  Foundation  (BK-:tr22) 
t  Supported  in  part  liy  the  Air  Force  Office  of  Scientific  Research 

0499) 


(AFOSR  F49620-92-.]- 
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A  NEURAL  NETWORK  MODEL  OF  DYNAMIC 
RECEPTIVE  FIELD  REORGANIZATION 

I’,  (iaudiaiio,  S.  Olson,  D.  Tal.  and  B.  Fischl 

Society  for  Neuroscience  Ahstrncls,  1993.  19,  #328.19 


Abstract 

Primary  sensory  cortex  is  traditionally  viewed  as  a  passive  filter,  extracting  information 
for  processing  in  higher  cortical  centers. '  However,  recent  experiments  have  revealed  a  re¬ 
markable  degree  of  plasticity  in  primary  sensory  cortex,  particularly  in  visual  cortex  (Gilbert, 
1992;  Heinen  k  Skavenski, 'l991;  Kaas'c/  ai,  1991)  and  somatosensory  cortex  (Merzenich  ct 
al.  1984;  Pons  ct  al..  1991;  Ramachandran  ct  al,  1992).  Receptive  fields  of  cells  in  visual 
cortex  have  been  shown  to  respond  dynamically  to  changes  in  the  visual  environment,  both 
within  and  outside  the  cells’  classically  defined  receptive  fields.  This  reorganization  occurs 
on  a  variety  of  time  scales,  from  seconds  to  years  (Gilbert,  1992).  We  show  a  simple  neural 
network  model  based  on  .Adaptive  Re.sonance  Theory  (.ART:  Garpenter  k  Grossberg,  1987; 
Grossberg.  1976)  that  displays  some  of  the  dynamical  reorganization  found  in  visual  and 
somatosensory  cortex.  .According  to  .ART.  plasticity  is  maintained  throughout  life,  although 
feedback  interactions  prevent  spurious  reorganization  during  normal  cortical  function.  In 
qualitative  agreement  with  experimental  results,  simulated  cortical  cell  receptive  fields_  ex¬ 
pand  and  contract  as  a  result  of  attentional  influences,  real  and  artificial  retinal  lesions 
(both  immediate  and  long-term  reorganization),  and  preferential  stimulation.  Information 
from  outside  a  cell's  receptive  field  directly  and  indirectly  mediates  the  cell’s  response.  Both 
the  rapid  and  long-term  receptive  field  reorganizations  arise  as  a  conseciuence  of  nonlin¬ 
ear  network-level  interactions  that  are  not  fully  e.xplicable  by  examining  the  responses  of 
individual  neurons. 


Sui)])orted  in  ]nirt  l:)y  the  Air  Force  Office  of  Scientific.  Research  (AFOSR  F49620-92-.]- 
0499  and  AFOSR  F49620-92- .1-0334),  British  Petroleum  (BP  89A-1204),  the  National  Science 
Foundation  (NSF  IRI  90-24877),  and  the  Sloan  Foundation  (BR-3122). 
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\N  UNSUPERVISED  NEURAL  NETWORK  FOR  REAL-TIME 
LOW-LEVEL  CONTROL  OF  A  MOBILE  ROBOT: 

NOISE  RESISTANCE,  STABILITY,  AND  HARDWARE  IMPLEMENTATION 

I’aolo  (Jaiuliaiiot,  Erhiardo  Zalauia,  and  Juan  Lopez  Coronado 

Technical  Report  CAS/('NS-TK-94-019 
Boston,  MA:  Boston  University 

IEEE  TvcimHctions  on  Systems,  Man,  mid  (ybernetics,  in  press,  1994 


Abstract 

We  have  recently  introduced  a  neural  network  mobile  robot  controller  (NETMORC). 
The  controller  is  based  on  earlier  neural  network  models  of  biological  sensory-motor  control. 
We  have  shown  that  NETMORC  is  able  to  guide  a  differential  drive  mobile  robot  to  an 
arbitrary  stationary  or  moving  target  while  compensating  for  noise  and  other  forms  of  dis¬ 
turbance.  such  as  wheel  sli])page  or  changes  in  the  robot  s  plant.  Furthermore,  NETMORC' 
is  able  to  adapt  in  res])onse  to  long-term  changes  in  the  robot  s  plant,  such  as  a  change  in 
the  radius  of  the  wheels.  In  this  article  we  first  review  the  NETMORC  architecture,  and 
then  we  prove  that  NETMORC  is  asymptotically  stable.  After  presenting  aperies  of  sim¬ 
ulations  results  showing  robustness  to  disturbances,  we  compare  NETMORC.  performance 
on  a  trajectorv-following  task  with  the  performance  of  an  alternative  controller.  Finally,  we 
describe  preliminary  results  on  the  hardware  implementation  of  NETMORC  with  the  mobile 
robot  ROB  I  TER. 


t  Supported  in  part  by  the  Air  Force  Office  of  Scientific  Researchh  (AFOSR  F496‘20-92- 
.1-0499)  and  the  Sloan  Foundation  (BR-3122). 
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BOUNDARY,  BRIGHTNESS,  AND  DEPTH  INTERACTIONS 
DURING  PREATTENTIVE  REPRESENTATION  AND 
ATTENTIVE  RECOGNITION  OF  FIGURE  AND  GROUND 

Stephen  (Irosisbergt 

Technical  Report  (’AS/('NS-TR-93-003 
Boston,  MA:  Boston  University 
Italian  Journal  of  Psychology,  1993,  XX,  771-804 


Abstract 

This  article  applies  a  recent  theory  of  3-D  biological  vision,  called  F.4CADE  Theory,  to 
explain  several  percepts  which  Kanizsa  pioneered.  These  include  3-D  pop-out  of  an  occlud¬ 
ing  form  in  front  of  an  occluded  form,  leading  to  completion  and  recognition  of  the  occluded 
form;  3-D  transpai'ent  and  opacpie  percepts  of  Kanizsa  scjuares.  with  and  without  Varin 
wedges;  and  interactions  between  percepts  of  illusory  contours,  brightness,  and  depth  in  re¬ 
sponse  to  2-D  Kanizsa  images.  These  explanations  clarify  how  a  partially  occluded  object 
representation  can  be  completed  for  purposes  of  object  recognition,  without  the  completed 
part  of  the  representation  necessarily  being  seen.  The  theory  traces  these  percepts  to  neural 
mechanisms  that  com])ensate  for  measurement  uncertainty  and  com])lementarity  at  individ¬ 
ual  cortical  processing  stages  by  using  parallel  and  hierarchical  interactions  among  several 
cortical  processing  stages.  These  interactions  are  modelled  by  a  Boundary  Uontour  System 
(BUS)  that  generkes  knergent  boundary  segmentations  and  a  complementary  Feature  Con¬ 
tour  System'  (FCS)  that  fil'ls-in  surface  representations  of  brightness,  color,  and  depth.  The 
BCS  and  FCS  interact  reciprocally  with  an  Object  Recognition  System  (ORS)  that  binds 
BCS  boundary  and  FCS  surface  representations  into  attentive  object  representations.  The 
BCS  models  the  parvocellular  LGN-Interblob-Int.erstripe-V4  cortical  processing  stream, 
the  FCS  models  the  parvocellular  LCN— Blob-Thin  Stripe-V4  cortical  processing  stream, 
and  the  ORS  models  inferotem])oral  cortex. 


t  Sup]xnted  in  ]nirt  l)y  the  Air  Force  Office  of  Scientific  Research  (.4FOSR  F49620-92- 
.1-0499),  ARPA  (ONR  NT)0014-92-.]-4015)  and  the  Office  of  Naval  Research  (N00014-91-.1- 

4100). 
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SPEECH  SOUND  ACQUISITION,  COARTICULATION,  AND 
RATE  EFFECTS  IN  A  NEURAL  NETWORK  MODEL 
OF  SPEECH  PRODUCTION 


Frank  H.  Cuenthert 

Technical  Report  ('AS/('NS-TR-94-01 
Boston.  MA:  Bcxston  University 
Psychological  Review,  in  press.  1994 


Abstract 

This  work  describes  a  neural  network  mode!  of  speech  motor  skill  acciuisition  and  speech 
production  that  ex]da.ins  a  wide  range  of  data  on  contextual  variability,  motor  eciuivalaice, 
coarticulation,  and  speaking  rate  effects.  Model  parameters  are  learned  oanng  a  babbling 
phase.  To  explain  how  infants  learn  phoneme-specific  and  language-specific  bmit.s  on  ac¬ 
ceptable  articulatory  variabilitv.  the  learned  speech  sound  targets  take  the  form  of  multi¬ 
dimensional  regions.,  or  convex  hulls,  in  orosensory  coordinates.  Reduction  of  taijet  size  for 
better  accuracy  during  slower  speech  (in  the  spirit  of  the  speed-accuracy  tiade-off  desciibed 
bv  Fitts'  law)  leads  to  differential  effects  for  vowels  and  consonants,  as  seen  in  speaking  rate 
experiments  that  have  lieen  previously  taken  as  evidence  for  separate  control  processes  foi 
tiie  two  sound  types.  An  account  of  anticipatory  coarticulaiion  is  posited  wlierein  the  target 
for  a  speech  sound  is  reduced  in  size  liased  on  context  to  provide  a  more  efficient  seciuence 
of  articulator  movements.  This  explanation  generalizes  the  well-known  look-afiead  model  of 
coarticulation  to  incorporate  convex  hull  targets.  _  Computer  simulatipms  verify  the  model  s 
properties,  including  linear  velocity/distance  relationships,  motor  e(iui\alence,  speaking  late 
effects,  and  carryover  and  anticii)atory  coarticulation. 


t  Supported  in  ])art  liy  the  Air  Force  Office  of  Scientific  Research  (AFOSR  F49620-92-.]- 
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A  NEURAL  NETWORK  MODEL  OF  SPEECH  ACQUISITION 
AND  MOTOR  EQUIVALENT  SPEECH  PRODUCTION 

Frank  II.  (luentberf 

Technical  Report  (’AS/('NS-TR-93-054 
Boston,  MA;  Boston  ITiiversity 
Biological  CvhornPtics,  in  press,  1994 


Abstract 

This  article  describes  a  neural  network  mode!  that  addresses  the  accjuisition  of  speaking 
skills  by  infants  and  subsequent  motor  eciuivalent  production  of  speech  sounds.  The  model 
learns  two  mappings  during  a  babbling  phase.  An  auditory-to-orosensory  mapping  specifies 
a  vocal  tract  target  for  each  speech  sound;  these  targets  take  the  form  of  convex  hulls  in 
orosensory  coordinates  defining  the  shape  of  the  vocal  tract.  The  babbling  process  wherein 
these  convex  hull  targets  are  formed  explains  how  an  infant  can  learn  phoneme-  specific 
and  language-specific  limits  on  acceptable  variability  of  articulator  movements.  The  model 
also  learns  an  orosensory-to-articulatory  mapping  wherein  cells  coding  desired  movement 
directions  in  orosensory  siiace  learn  articulator  movements  that  achieve  these  orosensory 
movement  directions.  The  resulting  mapping  provides  a  natural  explanation  for  the  forma¬ 
tion  of  coordinative  structures.  This  mapping  also  makes  efficient  use  of  redundancy  in  the 
articulator  system,  thereby  providing  the  model  with  motor  ecpii valent  capabilities.  Simula¬ 
tions  verify  the  model's  ability  to  compensate  for  constraints  or  perturbations  applied  to  the 
articulators  automatically  and  without  new  learning  and  to  explain  contextual  variability 
seen  in  human  speech  production. 
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Abstract 

The  Adaptive  Resonance  Theory  (ART)  arriiitecture.  first  proposed  by  Crossberg  (1976a, 
1976b),  is  a  self-organizing  neural  network  for  stable  pattern  categorization  in  response  to 
arbitrary  input  seciuences.  Since  its  original  formulation,  several  versions  of  ART  have  beep 
proposed,  each  designed  to  handle  a  particular  task  or  input  format.  Recent  ART  archi¬ 
tectures  have  been  designed  to  work  in  a  supervised  fashion,  offering  a  viable  alternative 
to  su]:)e,rvised  neural  networks  such  as  luickpropagation  (Rumelhart.  1_9S6).  Perhaps  the 
best-known  variant  of  ART  is  ART  2  (('arpenter  and  Crossberg,  19S0.  an  unsupervised 
neural  network  that  handles  analog  inputs.  We  have  developed  a  series  of  simulators  for 
some  of  the  .ART-family  neural  architectures,  namely,  .ART  2  (Carpenter  and  Crossberg, 
1987),  ART2-A  (Carpenter,  Crossberg,  and  Rosen.  1991a),  Fuzzy  ART  (('arpenter,  Cross¬ 
berg,  and  Rosen.  1991b),  and  Fuzzy  .ARTMAP  (Carpenter,  Crossberg.  Markuzon.  Reynolds, 
and  Rosen.  1992).  This  article  briefly  summarizes  the  history  and  functionality  of  ART  and 
its  variants,  and  then  describes  the  software  package,  which  is  available  in  the  public  domain. 
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Abstract 

This  article  introduces  a  real-time,  iinsiipervised  neural  network  model  that  learns  to 
control  a  two-degree-of-freedom  (2-[)OF)  nonholonomic  mobile  robot  in  a  nonstationary  en¬ 
vironment.  The  model  combines  associative  learning  and  Vector  Associative  Map  (VAM) 
learning  to  generate  transformations  between  spatial  and  velocity  cooi’dinates.  The  trans¬ 
formations  are  generated  in  an  initial  training  phase,  during  which  the  robot  moves  as  a 
result  of  endogenously  generated  velocities  applied  to  the  robot’s  wheels.  The  robot  learns 
the  relationship  between  these  small  velocities  and  the  resulting  incremental  movements. 
During  performance,  the  use  of  a  VA.M  architecture  enables  the  robot  to  generalize  from  the 
learned  incremental  movements  to  reach  targets  at  arbitrary  distance  and  angle  from  the 
robot.  The  VAM  structure  also  enables  the  robot  to  perform  successfully  in  spite  of  drastic 
changes  to  the  robot’s  plant,  including  changes  in  wheel  radius,  changes  in  inter-wheel  dis¬ 
tance,  or  changes  in  the  internal  time  step  of  the  system.  This  article  describes  the  model, 
presents  illustrative  simulation  results  that  include  both  target  and  trajectory  tracking,  and 
compares  the  model  to  other  neural  network  and  classical  approaches  to  control. 


t  Supported  in  jiart  Iry  the  Air  Force  Office  of  Scientific.  Research  (AFOSR  F49620-92-.]- 
0499)  and  the  Sloan  Foundation  (BR.-4122). 


